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Abstract 


Results: 19 and 


Background: We conducted a systematic review and meta-analysis to evaluate the efficacy of ivermectin for COVID- 
19 patients based on current peer-reviewed RCTs and to address disputes over the existing evidence. 


Methods: MEDLINE (Pubmed), Scopus, Web of Science, Cochrane library, Google scholar and Clinicaltrials.gov were 
searched for RCTs assessing the efficacy of Ivermectin up to 20 February 2022. A systematic review and meta-analysis 
of studies was performed based on the PRISMA 2020 statement criteria. 


17 studies were included in this systematic review and meta-analysis, respectively. There was no 
significant difference in progression to severe disease (log OR — 0.27 [95% Cl — 0.61 to 0.08], 12 = 42.29%), nega- 

tive RT-PCR (log OR 0.25 [95% Cl — 0.18-0.68], 12 = 58.73%), recovery (log OR 0.11 [95% Cl — 0.22-0.45], 12 = 13.84%), 
duration of hospitalization (SMD — 0.40 [95% Cl — 0.85-0.06], 12 = 88.90%), time to negative RT-PCR (SMD — 0.36 
[95% Cl — 0.89-0.17], 12 = 46.2%), and viral load (SMD -0.17 [95% Cl -0.45 to 0.12], /A2 =0%). It is worth noting that, 
based on low-certainty evidence, ivermectin may possibly reduce mortality (log OR — 0.67 [95% Cl — 1.20 to — 0.13], 
12 = 28.96%). However, studies with a higher risk of bias were more likely to indicate positive effects on the efficacy of 
this drug, according to our subgroup analyses based on study quality. 


Conclusion: lvermectin did not have any significant effect on outcomes of COVID-19 patients and as WHO recom- 
mends, use of ivermectin should be limited to clinical trials. 
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Introduction 

In December 2019, a cluster of cases of pneumonia with 
unknown etiology was reported in Wuhan, China [1]. 
Patients presented to healthcare facilities with flu-like 
symptoms such as dyspnea, dry cough, and fever. In 
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January 2020 the agent causing the disease was named 
severe acute respiratory syndrome-coronavirus 2 (SARS- 
CoV-2). This unprecedented situation left health pro- 
viders with lack of sufficient information regarding the 
source and means of transmission of the virus resulting 
in the inability to prevent the rapid spread of the disease 
throughout the world. On 11th March 2020, novel coro- 
navirus disease (COVID-19) caused by SARS-CoV-2 was 
declared a pandemic by WHO [2]. 
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Since the emergence of novel coronavirus disease 
(COVID-19), over 5 million worldwide deaths have been 
reported by WHO [3]. Attempts were made to imple- 
ment appropriate treatment strategies against the dis- 
ease. Although there is no certain treatment approved 
by official health organizations for most patients in the 
early stage of the disease, pharmacotherapies including 
drugs such as hydroxychloroquine, azithromycin, and 
remdesivir have been employed as possible treatments 
for COVID-19 [4]. Several clinical trials were conducted 
to determine the efficacy of candidate drugs, however 
further investigations on other promising drugs are still 
required [5]. 

Ivermectin, a low-cost, simple-to-use, and widely avail- 
able FDA-approved anti-parasitic drug, is one of the pro- 
posed drugs for treating COVID-19 patients [6], and it 
has sparked one of the greatest debates since the begin- 
ning of the pandemic [7-10]. An in-vitro study pub- 
lished by Caly et al.[11] reported that ivermectin inhibits 
SARS-CoV-2 replication with a 5000-fold reduction in 
viral RNA level during the first 48 h of usage. Although 
ivermectin is considered an anti-parasite agent, there 
is some evidence that proves its efficacy against viruses 
[12, 13]. Additionally, a preprint trial by Elgazzar et al. 
[] showed encouraging positive effects of ivermectin on 
COVID-19 patients. Following these publications, several 
low-quality studies were conducted to evaluate the effect 
of ivermectin on COVID-19 patients [14, 15]. These stud- 
ies were included in a number of systematic reviews and 
meta-analyses that reported the beneficial effect of this 
medication [14, 16-18]. Furthermore, recent RCTs have 
shown that ivermectin is ineffective in the treatment of 
COVID-19 [19, 20]. Since the beginning of the pandemic, 
all of these have caused controversy regarding the possi- 
ble effects of this drug. And despite the fact that WHO 
recommends that ivermectin must be used solely in 
clinical trials to treat COVID-19, according to recently 
published studies, the misuse of this medication and a 
significant number of ivermectin prescriptions have been 
widely documented, particularly in the United States [9, 
10]. 

After about two years since the beginning of the 
COVID-19 pandemic, valuable lessons were achieved 
from ivermectin in the context of COVID-19 for inves- 
tigating future proposed therapeutic targets in the era 
of the pandemic, which are of high importance for both 
researchers and clinicians. Moreover, further informa- 
tion regarding possible therapeutic agents that would 
reduce mortality and change the course of COVID-19 
is desperately needed. There are some concerns regard- 
ing the accuracy of the results of previous studies that 
should be addressed. The most important concerns are 
several retractions of clinical trials [21], the availability 
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of inaccurate or outdated meta-analyses [14, 22, 23], and 
three RCTs recently published in 2022 [19, 20, 24] which 
their final results were not included in previous meta- 
analyses. Considering these issues, we set out to conduct 
a comprehensive systematic review and meta-analysis of 
current peer-reviewed randomized controlled trials to 
assess the possible effect of ivermectin in patients with 
COVID-19. We also reviewed and discussed the possible 
sources of the controversial opinions regarding this drug, 
assessed the current state of available ivermectin sys- 
tematic reviews and meta-analyses, and highlighted key 
elements that could lead to reliable investigations into 
potential therapeutic targets in future research. 


Methods 

Search strategy 

We have performed a systematic review and meta-anal- 
ysis in accordance with the recommendations from the 
Cochrane Handbook [25]. The Preferred Reporting Items 
for Systematic Reviews and Meta-Analyses (PRISMA) 
was used in this study [26]. The protocol of our study is 
registered at Alborz University of Medical Sciences with 
the number IR.ABZUMS.REC.1400.321. 

MEDLINE (Pubmed), Scopus, Web of Science, 
Cochrane library, Google scholar and Clinicaltrials. 
gov were assessed by our reviewers (A.S and M.T) who 
designed a search strategy using the search string: 
(((((("COVID-19"[Mesh]) OR ("SARS-CoV-2"[Mesh])) 
OR (COVID-19)) OR (Coronavirus)) OR (nCoV)) OR 
(SARS-Cov-2)) AND ((((((("Ivermectin"[Mesh]) OR (MK- 
933)) OR (Stromectol)) OR (Mectizan)) OR (Eqvalan)) 
OR (Ivomec)) OR (Ivermectin)) (Further details avail- 
able in Additional file 1: Table S1 supplementary data). 
All publications were retrieved up to 20 February 2022. 
We also investigated the reference sections of other sys- 
tematic reviews and meta-analyses for relevant RCTs. 
Pre-print databases were not included due to concerns 
around non-peer-reviewed studies regarding ivermectin 
[14, 15]. The result was exported to the EndNote X9 pro- 
gram for further screening. 


Study selection and data extraction 

Articles eligible for inclusion were: 1) confirmed COVID- 
19 patients, 2) randomized clinical trials comparing 
ivermectin to standard of care (SOC) or placebo, 3) 
evaluated relevant outcomes in this topic. To avoid low- 
quality studies affecting the overall results, we excluded 
non-randomized trials, observational studies, and non- 
peer-reviewed databases. Screening was performed in 
duplicate and two-step selection has been undertaken 
by two reviewers (A.S and M.T). Studies were screened 
via titles and abstracts followed by full-texts in EndNote. 
All disagreements were resolved by means of discussion 
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with a third reviewer to reach an agreement (K.J). Data 
were extracted from text, tables, figures, graphs, and sup- 
plementary materials. Author name, year of publication, 
country of origin, study design, intervention and control 
arm descriptions, total number of patients in each trial, 
and outcome data were all extracted by three reviewers 
independently (A.S and M.T and S.S). In case of stud- 
ies with unavailable or inadequate data, we attempted to 
contact the corresponding author to receive the unpub- 
lished data. Studies reporting median and interquartile 
range for their outcomes were analyzed for no significant 
skewness [27]. The estimated mean and standard devia- 
tion of eligible studies were used for meta-analysis [28, 
29]. 


Quality assessment 

Two reviewers (K.J and M.T) independently assessed the 
included studies using Cochrane ROB-2 tool [30]. All 
included studies were rated as “High’, “Some concerns’, 
and “Low” based on ROB-2 checklist. We assessed the 
quality of evidence for our outcomes using the Grading 
of Recommendations, Assessment, Development and 
Evaluations (GRADE) framework [31]. 


Outcome measure 

Our primary outcomes include rate of mortality, progres- 
sion to severe or critical state, and negative RT-PCR. Our 
secondary outcomes include recovery rate, duration of 
hospitalization, time to negative RT-PCR, and viral load. 


Data synthesis and analysis 

Data was pooled using the random-effects method 
because the indicators were supposed to vary across 
studies and there was variability among the studies. The 
log odds ratio (log OR) was used to summarize the over- 
all effect of dichotomous outcomes and the standardized 
mean difference (SMD) was used to describe the overall 
effect of continuous outcomes. Study heterogeneity was 
assessed using [2 statistic, with I2 values of <50%, 50% to 
75%, and>75% indicating low, moderate, and high het- 
erogeneity, respectively. While [2 is the most commonly 
used measure of heterogeneity, the 12 measure increases 
with an increasing number of trials, making it harder to 
compare [2 across analyses, therefore we report both 12 
and Tau for each analysis under primary outcomes. Pub- 
lication bias was assessed using funnel plots and Egger’s 
regression test for funnel plot asymmetry. In terms of 
publication bias existence, a trim and fill analysis were 
used to evaluate the number of missing studies and the 
effect of imported studies on effect size. Subgroup anal- 
ysis were performed to seek the possible effect of study 
quality and funding on overall effect. Sensitivity analysis 
was conducted by using leave-one-out analysis to assess 
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the individual study effect on pooled results. A meta- 
regression was used in terms of moderate or high het- 
erogeneity to investigate the association between effect 
size and covariates. Publication bias, subgroup, sensitiv- 
ity, and meta-regression analyses were only done on pri- 
mary outcomes as a small number of studies have been 
included in the secondary outcomes. Stata version 17 sta- 
tistical software (Stata Corp, College Station, TX, USA) 
was used for quantitative synthesis. 


Results 

We identified 2177 relevant studies through database 
searching and 619 duplicates were removed (Fig. 1). 
After screening the titles and abstract, 45 full-texts were 
reviewed and 19 RCTs were included. Due to lack of data 
of one of the studies, we attempted to contact the cor- 
responding, but received no response [32]. Finally, a total 
of 19 and 17 studies (involving 4328 participants) were 
included in the systematic review and meta-analysis, 
respectively. 


Characteristics of included studies 

Among the included studies, eleven were conducted in 
Asian countries, including India (n=3), Iran (n= 2), Iraq 
(n=1), Egypt (n= 1), Bangladesh (n= 2), Malaysia(n=1), 
and Turkey (n=1), five in the Americas, including Bra- 
zil (n=2), Colombia (n=1), Argentina (n=2), two in 
Europe, including Spain (n=1), Italy (n=1), and one in 
Africa, including Nigeria (n=1). The majority of partici- 
pants were mild to moderate COVID-19 patients who 
had been diagnosed early. Some trials used a standard of 
care regimen in combination with ivermectin, although 
most of them did not specify the exact medications used. 
As these combinations may affect the efficacy of ivermec- 
tin, studies not specifying the SOC are probably biased. 
Detailed characteristics of each study is provided in 
Table 1. 


Risk of bias 

Figure 2 shows the overall risk of bias of included studies. 
Risk of bias was rated as low in 7 trials, some concerns 
in 2 trials, and high in 9 trials. We have provided our 
detailed explanation for each study in the supplementary 
data (Additional file 1: Fig. $1). 


Primary outcomes 

Mortality 

A total of 10 RCTs, including 3472 COVID-19 patients, 
reported a rate of mortality in their studies. Figure 3A) 
[19, 24, 34, 36-39, 41, 43, 47]. The pooled log OR was 
—0.67 (95% CI — 1.20 to — 0.13) with low heterogeneity 
(142 = 28.96%, Tau=0.20). The pooled results showed 
that ivermectin may have a possible effect on lowering 
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Fig. 1 Evidence search and selection based on the PRISMA (Preferred reporting items for systematic reviews and meta-analyses) approach 


the mortality rate. However, our subgroup analysis based 
on study quality found that ivermectin had no significant 
effect on mortality in trials with low ROB (log OR — 0.12, 
95% CI 0.— 0.66—0.42; 12 =00%, Tau=0.00). While in tri- 
als with high ROB, there was a considerable reduction in 
mortality rate in the ivermectin group (log OR — 1.06, 
95% CI — 1.65 to — 0.47; 12=0.00% Tau=0.00) (Fig. 4A). 
To explore the possible effects of funding sources on 
the results of clinical trials, subgroup analysis between 
studies with and without funding was performed. There 
were no significant differences between funded (log OR 
—0.44, 95% CI 0. —1.00-0.12; 12=7.17%, Tau=0.04) 


and non-funded (log OR — 0.71, 95% CI 0. — 1.65-0.22; 
12=44.77%, Tau =0.49) trials (Additional file 1: Fig. S2-A 
supplementary data). Sensitivity analysis using leave-one- 
out method revealed the overall effect was substantially 
altered when the study by Shakhsi Niaee et al. was omit- 
ted (Additional file 1: Fig. S3-A supplementary data) [39]. 
There was no publication bias based on inspection of fun- 
nel plot and Egger’s regression test (py =0.65) (Fig. 5A). 


Progression to severe disease 
A total of 9 RCTs, including 3594 COVID-19 patients, 
reported progression to severe disease in their 
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studies (Fig. 3B) [19, 24, 34, 36-38, 41, 44, 47]. The 
pooled log OR was —0.27 (95% CI -0.61 to 0.08) with 
low heterogeneity (I*2 = 42.29%, Tau=0.09). The pooled 
results showed that ivermectin does not have an effect on 
lowering the rate of progression to severe disease. Our 
subgroup analysis based on study quality revealed that 
ivermectin had no significant effect in disease progres- 
sion in trials with low ROB (log OR -0.16, 95% CI -0.42 
to 0.10; 12=0.00%, Tau =0) and high ROB (log OR -0.26, 
95% CI -0.99 to 0.47; 12=47.22%, Tau=0.26) (Fig. 4B). 
There were no significant differences between funded 
(log OR —0.29, 95% CI 0. —0.71 to —0.13; 12=15.69%, 
Tau=0.04) and non-funded (log OR -0.21, 95% CI 0. 
—0.76-0.35; 12=53.77%, Tau=0.19) trials (Additional 
file 1: Fig S2-B supplementary data). Sensitivity analysis 
using leave-one-out method revealed the overall effect 
was substantially altered by removing one study [19] 
(Additional file 1: Fig. S3-B supplementary data). There 
was no publication bias based on inspection of funnel 
plot and Egger’s regression test (p=0.61) (Fig. 5B). 


Negative RT-PCR 

A total of 9 RCTs, including 2679 COVID-19 patients, 
reported incidence of negative RT-PCR test in their 
studies (Fig. 3C) [24, 33, 38, 41-44, 46]. The pooled log 
OR was 0.25 (95% CI -0.18 to 0.68) with moderate het- 
erogeneity (I.2=58.73%, Tau =0.23). The pooled results 
showed that ivermectin does not have an effect on 
increasing the rate of negative RT-PCR. Our subgroup 
analysis based on study quality revealed that ivermec- 
tin had no significant effect in negative RT-PCR rate in 
trials with low ROB (log OR -0.14, 95% CI -0.43 to 0.15; 
12=0.00%, Tau=0). However, in trials with high ROB, 
there was a significant increase in negative RT-PCR rate 
in the ivermectin group (log OR 0.99, 95% CI 0.17—1.80; 
12=3.42% Tau=0.03) (Fig. 4C). No significant differ- 
ences between funded (log OR 0.02, 95% CI 0 —0.32 to 
0.36; 12=0.00%, Tau=0.00) and non-funded (log OR 
0.48, 95% CI 0. -0.41 to 1.37; 12=80.46%, Tau=0.49) 


studies were observed (Additional file 1: Fig S2-C sup- 
plementary data). Sensitivity analysis using leave-one-out 
method revealed the overall effect was not substantially 
altered when any single study omitted (Additional file 1: 
Fig. S3-C supplementary data). There was no publica- 
tion bias based on visual inspection of funnel plot and 
Egger’s regression test (y=0.10) (Fig. 5C). Although the 
heterogeneity was reduced by subgrouping studies based 
on their risk of bias, a meta-regression analysis was per- 
formed to assess other possible sources of heterogeneity 
using sample size, age, and exposure as covariates. The 
association between ivermectin and increased nega- 
tive RT-PCR was significantly affected by drug exposure 
(p=0.01). Furthermore, the results showed that the rate 
of negative RT-PCR was not influenced by sample size 
(p =0.56) and age (p =0.78) (Fig. 6). 


Secondary outcomes 

Recovery 

A total of 4 RCTs, including 1125 COVID-19 patients, 
reported an incidence of patients recovered in their 
studies (Fig. 3D) [19, 37, 38, 42]. The pooled log OR 
was 0.11 (95% CI —0.22-0.45) with low heterogeneity 
(I.2 = 13.84%, Tau=0.02). The pooled results showed 
that ivermectin does not have an effect on increasing the 
rate of recovery. 


Duration of hospitalization 

A total of 5 RCTs, including 908 COVID-19 patients, 
reported duration of hospitalization in their stud- 
ies. (Fig. 3E) [19, 34, 36, 45, 47]. The pooled SMD was 
—0.40 (95% CI —0.85-0.06) with high heterogeneity 
(182 = 88.90%, Tau=0.23). The pooled results showed 
that ivermectin does not have an effect on decreasing the 
duration of hospitalization. 


Time to negative RT-PCR 
A total of 3 RCTs, including 138 COVID-19 patients, 
reported time to negative RT-PCR in their studies. 
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Fig. 3 Forest plots showing the results of meta-analyses for primary outcomes. A Mortality, B Progression to severe disease, C Negative RT-PCR. 
Forest plots showing the results of meta-analyses for secondary outcomes. D Recovery, E Duration of hospitalization, F Time to negative RT-PCR, 


and G Viral load 


(Fig. 3F) [33, 40, 45]. The pooled SMD was — 0.36 (95% 
CI —0.89-0.17) with low heterogeneity (142 = 46.2%, 
Tau=0.10). The pooled results showed that ivermectin 


does not have an effect on decreasing the time to nega- 
tive RT-PCR. 


Viral load 

A total of 2 RCTs, including 200 COVID-19 patients, 
reported viral load in their studies. (Fig. 3G) [20, 42]. 
The pooled SMD was —0.17 (95% CI —0.45-0.12) with 
low heterogeneity (I‘2=0%, Tau=0.00). The pooled 
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Fig. 4 Meta-analysis of primary outcomes in subgroups based on the quality of included RCTs. In contrast to low biased trials, studies with a high/ 
moderate risk of bias have indicated ivermectin efficacy in the majority of cases. A Mortality, B Progression to severe disease, C Negative RT-PCR 


results showed that ivermectin does not have an effect on 
decreasing the viral load. 


Quality of evidence 
The summary of findings and quality of evidence for 
study outcomes is available in Table 2. 


Discussion 

Main findings 

To our knowledge, this is the most comprehensive sys- 
tematic review and meta-analysis of the efficacy of iver- 
mectin among COVID-19 patients in peer-reviewed 


randomized clinical trials. Our aim was to appraise 
potential efficacy of ivermectin compared to placebo or 
SOC. Although our preliminary results suggest that iver- 
mectin may reduce mortality, it is crucial to highlight 
that when trials with a high risk of bias are excluded, 
ivermectin results in a non-significant decrease in mor- 
tality. We found that in comparison with placebo or 
SOC, using ivermectin did not significantly change our 
outcomes, including progression to severe disease, nega- 
tive RT-PCR, recovery, duration of hospitalization, time 
to negative RT-PCR, and viral load. Although no risk of 
publication bias was observed in primary outcomes, it is 
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noteworthy that, based on the Cochrane handbook’s sug- 
gestions, the power of these tests is too low for less than 
10 studies to be included. We also identified that some 
registered RCTs finished without reporting results and 
so there may be publication bias. The overall certainty of 
evidence suggest that more research is needed and final 
conclusions should not be drawn based on the current 
findings and there is insufficient evidence to recommend 
it for therapeutic purposes in the context of health care 
at this time. To determine the impact of individual stud- 
ies on the pooled estimate, a leave-one-out analysis was 
performed on primary outcomes. It was observed that 
omitting one study (Lim et al. [19]) considerably changed 
the pooled estimate of progression to severe disease. 
Therefore, further investigation into the results of this 
recently published study is necessary. Among 19 rand- 
omized trials included; 10 studies concluded that iver- 
mectin may have a possible effect in treating COVID-19. 


To address the conflicts and clear up the gray area; we 
precisely assessed the risk of bias of studies using the 
Cochrane risk-of-bias tool for randomized trials. Of all 
included studies in our review, 9 had a high risk of bias, 
and 2 had moderate risk of bias. This level of bias raises 
concerns regarding the accuracy of the results and qual- 
ity of the studies and should be noted to prevent wrong 
conclusions. Any decision made upon the findings of 
these studies should be carefully appraised before taking 
it into action to avoid possible complications. A study by 
Shakhsi-Niaee et al. [39] declared a significant reduction 
in mortality rate among ivermectin groups. Howerever, 
we do not consider it as a valid source of information due 
to the low quality of evidence and unclear or high risk of 
bias in multiple domains [15, 48, 49]. In addition, major 
sources of concern have been raised about this study [39], 
which may lead to retraction of this study in the future 
[15, 50]. 
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Findings of other meta-analyses 

The first systematic review published on this topic by 
Padhy et al.[51] claimed a significant reduction in all- 
cause mortality and significant clinical improvement 
although stating a high risk of bias for all studies and 
very-low quality of evidence. Cruciani et al.[52] published 
a systematic review with the primary outcome of overall 
mortality and progression to severe disease including 
11 RCTs with 2436 participants. They concluded that 
when the analysis was limited to patients with baseline 
severe disease, ivermectin significantly decreased mor- 
tality compared to mild to moderate disease. However, 
they stated that the quality of evidence was very low due 
to the risk of bias. Kow et al. [53] concluded a prelimi- 
nary positive effect on reduction of all-cause mortality 
by reviewing 6 studies, although they declared a high risk 
of bias for 4 out 6 studies. Roman et al. [54] published a 


systematic review and meta-analysis with primary out- 
comes such as all-cause mortality, length of hospital stay, 
and AEs and secondary outcomes of SARS-CoV-2 clear- 
ance on respiratory samples, clinical improvement, need 
for mechanical ventilation, and severe AEs. Their quality 
assessment demonstrated a high risk of bias among 8 out 
of 10 studies, and they reported a low or very low qual- 
ity of evidence for all outcomes. They found that iver- 
mectin did not reduce primary or secondary outcomes 
in patients with mostly mild disease and claimed that 
ivermectin is not a viable option for treating COVID-19 
and should be used only in the context of clinical tri- 
als. Deng et al. [55] published a systematic review which 
excluded retracted studies and articles withdrawn from 
preprint servers. They concluded that based on available 
evidence, ivermectin does not significantly alter the out- 
comes of the disease including viral clearance, duration 
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Table 2 lvermectin compared to control for COVID-19 patients 
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Patient or population: COVID-19 
Intervention: Ivermectin 
Comparison: Standard of care or Placebo 


Outcomes No of participants Certainty of the evidence _ Ref 
(studies) (GRADE) 
Follow up 
Mortality 3472 SOOQ 19, 24, 34, 36-39, 41, 43, 47] 
10 RCTs) Very low* 
Progression to severe or critical state 3594 &6OO 19, 24, 34, 36-38, 41, 44, 47] 
9 RCTs) Low” 
Negative RT-PCR 2679 BOO 24, 33, 38, 41-44, 46] 
9 RCTs) Very low?" 
Recovery 1125 S6OO 19, 37, 38, 42] 
4 RCTs) Low*" 
Duration of hospitalization 908 BOO 19, 34, 36, 45, 47] 
5 RCTs) Very low® d 
Time to negative RT-PCR 138 BOO 33, 40, 45] 
3 RCTs) Low?* 
Viral load 200 BOO 20, 42] 
2 RCTs) Low® 


Explanations 


GRADE Working Group grades of evidence 


High certainty We are very confident that the true effect lies close to that of the estimate of the effect 


Moderate certainty We are moderately confident in the effect estimate: The true effect is likely to be close to the estimate of the effect, but there is a possibility that it is 


substantially different 


Low certainty Our confidence in the effect estimate is limited: The true effect may be substantially different from the estimate of the effect 


Very low certainty We have very little confidence in the effect estimate: The true effect is likely to be substantially different from the estimate of effect 


* The proportion of information from studies at high risk of bias is sufficient to affect the interpretation of results. Crucial limitation for one criterion, or some 
limitations for multiple criteria, sufficient to lower confidence in the estimate of effect. Downgraded one or two levels based on the number of high-risk of bias studies 


> Wide confidence interval (uncertainty about magnitude of effect). Downgraded one level 


© Moderate heterogeneity. Downgraded one level 
4 High heterogeneity. Downgraded two level 


© Small sample size. Downgraded one level 


of hospitalization, mortality and incidence of mechanical 
ventilation. Except for mortality, their findings were con- 
sistent with our study in terms of the efficaciousness of 
ivermectin in the setting of COVID-19. The authors of a 
retracted meta-analysis [23] recently provided an update 
on their prior conclusions, which were based on sepa- 
rating the included studies regarding the quality of the 
trials as determined by the Cochrane Risk of Bias tool. 
The authors included 12 trials (including Elgazzar et al’s 
retracted study) to investigate the possible role of study 
quality in pooled results. Their findings are in line with 
our study, which demonstrates that studies with a high 
risk of bias or probable medical fraud were necessary to 
find a substantial positive effect of ivermectin on survival 
[56]. 


Strengths and limitations 

This review has strengths in several aspects. Our system- 
atic search protocol was designed for obtaining compre- 
hensive and up-to-date results from 6 databases. That 


helps to achieve a more accurate estimation of the effect 
of ivermectin. All of the studies included in our review 
are peer-reviewed RCTs meaning that we reviewed the 
highest level of evidence available to avoid deviation from 
the mainstream of evidence. We observed any supple- 
mentary data of the studies to maximize the amount of 
analyzed data and minimize errors. By excluding studies 
with questionable methodologies and inadequate follow- 
up periods, we avoided potential partiality. The evalu- 
ation of each outcome was based on the information 
obtained from at least 2 studies, and the certainty of the 
evidence was assessed for all reported outcomes. We also 
faced some limitations. Most of the studies included a 
small number of participants and presented low to mod- 
erate symptoms. Therefore, the assessment of patients 
with moderate to severe disease has remained a question. 
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Risk of bias was assessed high for several studies, and the 
quality of evidence for most of the outcomes is low, hence 
our concern about the applicability of results approv- 
ing ivermectin efficiency and safety. The majority of the 
research available did not elaborately elucidate their 
methodologies. In addition, number of studies had the 
standard of care or other co-interventions plus ivermec- 
tin as intervention and different type of comparators as 
control. This may affect the accuracy of findings of stud- 
ies as a proper comparison may not be possible under 
these circumstances. According to the limitations men- 
tioned above, further research involving large-scale RCTs 
with a broad spectrum of disease severity and longer fol- 
low-up periods is warranted in order to provide adequate 
evidence regarding the safety and efficacy of ivermectin 
use for treatment of COVID-19. 


In quest of an effective drug during a pandemic 

Recurrent surges in the mortality rates and economic 
consequences of the COVID-19 pandemic led to a 
distressing situation for societies. Accompanied by 
skepticism towards new drugs and vaccines and misinfor- 
mation spread by media, this situation resulted in people 
making efforts in order to seek any accessible treatment 
regardless of whether health authorities approved it as a 
safe and efficacious treatment against the disease. One of 
these drugs was ivermectin, a well-known drug which has 
been widely used as an anti-parasitic drug for a long time. 
The idea of overcoming a pandemic with a previously 
used, widely available and low-cost drug made it chal- 
lenging for scientists to prevent its public use. Cases were 
reported of individuals taking highly concentrated forms 
of this drug formulated for animals such as horses or pre- 
scriptions from physicians for treatment or prevention of 
COVID-19, resulting in hospitalization or ICU admission 
[57]. The lack of sufficient and concrete scientific evi- 
dence regarding the safety and efficacy of ivermectin was 
also a key factor in throwing the usage of this drug into 
question. Recent articles were arguing that studies evalu- 
ating the effect of ivermectin are biased and that there is 
a possibility of fraudulent manipulations in the method- 
ology of RCTs [58, 59]. To overcome this predicament, 
it is of crucial importance to gather the already-existing 
evidence from relevant studies and meticulously evalu- 
ate the outcomes of this drug. Our study was designed 
to impartially address this issue to provide a clear per- 
spective on the subject of ivermectin for clinicians and 
researchers. In the concept of COVID-19, useful lessons 
were learned from ivermectin for researching future 
potential therapeutic targets during a pandemic, which 
are critical for both researchers and clinicians. In addi- 
tion, we identified four possible domains that must be 
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evaluated by researchers whenever a new medication is 
proposed (Fig. 7). 

The quality of included studies in meta-analyses affects 
the accuracy of the results. As there are controversies 
regarding ivermectin, we assessed the quality of studies 
to minimize the misconceptions. Many meta-analyses 
were conducted based on results obtained from retracted 
RCTs or those with high ROB without addressing their 
impact sufficiently. This leads to the spread of misinfor- 
mation and the formation of low-quality evidence. The 
exclusion of studies with high or moderate risk of bias 
from our analyses on primary outcomes resulted in a 
significant difference in pooled effect results, suggesting 
that studies with high ROB play a major role in the cur- 
rent confusing state regarding the efficacy of this drug. To 
avoid this situation, the quality of included trials should 
be carefully evaluated before concluding that the drug is 
effective in pandemic situations. 

To date, a number of systematic reviews have been 
published on this subject. However, most of them include 
studies by Elgazzar et al. [], or Samaha et al. [60] which 
now have been retracted from the databases or preprint 
studies with no peer-review process. Through our man- 
ual MEDLINE search, we identified several systematic 
reviews and meta-analyses based on the results of these 
fraught studies, reporting an independently significant 
effect of this drug in their analyses which results in con- 
fusion in both clinicians and patients [16-18, 61-64]. 
We highly advise systematic review and meta-analyses 
authors to keep themselves informed even after their 
work has been published in order to keep their find- 
ings updated and avoid producing misleading informa- 
tion. This is particularly noticeable in the context of an 
outbreak such as COVID-19, where there is a pressing 
need for demonstrating whether novel therapy options 
are clinically beneficial, and a plethora of low-quality and 
dubious research are widely available due to the pressing 
demand. 

There have been several websites providing real time 
meta-analyses of ivermectin studies (https://ivmmeta. 
com/#top, https://cl9ivermectin.com/) reporting its sig- 
nificant beneficial effect based on non-peer-reviewed low 
quality trials. They also lack protocol registration includ- 
ing methodologies, search strategies, inclusion criteria, 
quality assessment of the included studies, and the cer- 
tainty of the evidence of the pooled estimates [14]. This is 
significant since the majority of individuals can find these 
websites by searching "ivermectin meta-analysis," which 
might cause misunderstandings. 

Funding source of the studies and its association with 
the reported results raises concerns regarding the valid- 
ity of results of the studies since conflicts of interest may 
affect the outcome of the trials. There are some studies 
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Fig. 7 Recommendations for researchers and meta-analysis authors for assessing the efficacy of future proposed medications during a pandemic 


in light of what we've learnt from ivermectin 


suggesting significant association between the source 
of funding and outcome of the studies [65, 66]. In these 
cases, researches may be subject to methodological bias 
in favor of effectiveness of the intervention, reporting 
positive effects more frequently. Therefore, it is of great 
importance to ensure that the results of the study are not 
influenced by the funding source, and the objectivity of 
the study is preserved. [67] We performed a subgroup 
analysis comparing studies that provided information 
regarding their funding source with studies that did not 
mention theirs. For most of the outcomes, there was a 
non-significant difference between subgroups in terms of 
reporting the efficacy of ivermectin, however, a slight dif- 
ference was observed in mortality rates. In such contro- 
versial state with possible conflicts of interest, it is crucial 
to carefully consider the funding source of the studies 
so as to reduce the probability of the study results to be 
affected by such confounding factors. This assurance 
could be achieved by journals and editors emphasizing 
the importance of this issue and demanding authors to 
provide sufficient information about their funding. 

There are some concerns regarding the misprescrip- 
tion of this drug that should be addressed [9, 10, 68]. 


Ivermectin is a currently used antiparasitic drug with 
proven efficacy against several diseases such as scabies 
and filariasis, thus shifting its use towards the treat- 
ment of COVID-19 will result in the diversion of lim- 
ited health-care sources, leaving us deprived of supplies 
necessary for combating burden of tropical diseases 
including the two mentioned above [58]. Furthermore, 
the minimum concentration needed to obtain the 
anti-SARS-CoV-2 effect of ivermectin is 5 uM, con- 
siderably higher than 0.28 uM, the maximum plasma 
concentration achieved in vivo with a dose of approxi- 
mately 1700 pg/kg (about nine times the dosificaition 
approved by FDA) [14]. In January 2022, a study by 
Buonfrate et al. investigated the efficacy and safety of 
high-dose ivermectin in the early treatment of COVID- 
19 patients [20]. The authors claimed that in all RCTs 
to date, they have utilized the highest dose of ivermec- 
tin in the concept of a clinical trial. Their treatment 
arm included ivermectin single dose 600 ug/kg, and 
1200 g/kg. However, they reported a non-significant 
difference between ivermectin and placebo in their pri- 
mary outcome, which was viral reduction. It is note- 
worthy that they have also seen some adverse events 
in both the 600 g/kg and 1200 g/kg groups, such as 
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photophobia, visual impairment, abdominal pain, nau- 
sea, and fatigue. This could suggest that the medicine is 
unsafe at higher doses. 


Conclusion 

Our review showed that ivermectin does not have any 
significant effect on most outcomes such as progression 
to severe disease, negative RT-PCR, recovery, duration 
of hospitalization, time to negative RT-PCR, and viral 
load. It can possibly decrease mortality, however most 
of the supporting data are from highly biased studies. 
Due to the low certainty of evidence and large number 
of studies with high/moderate risk of bias, there is still 
a need for further investigation with larger sample sizes 
to show whether ivermectin is a choice in the setting of 
COVID-19 patients with more confidence. In order to 
maintain our results up to date, we will prepare a major 
update to our work if new evidence significantly affects 
the study findings. 
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